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ABSTRACT 


TRILAB  I is  a medical  information  system  that  was  in- 
stalled in  the  clinical  laboratories  of  two  U.S.  Air  Force 
medical  centers.  During  design  and  implementation,  TRILAB  I 
was  referred  to  as  AFCLAS  (Air  Force  Clinical  Laboratory 
Automation  System) . Since  this  laboratory  information  system 
was  designed,  implemented,  and  evaluated  as  an  Air  Force 
project,  it  will  be  referred  to  as  AFCLAS  in  this  report. 

The  goal  of  AFCLAS  is  to  improve  the  operation  and  management 
of  clinical  laboratories,  thereby  enhancing  the  contribution 
of  the  laboratories  to  quality  patient  care.  This  report 
presents  the  results  of  physician,  nurse,  and  laboratory  staff 
surveys  conducted  at  the  Medical  Center,  Wright-Patterson 
(MCWP)  AFB,  in  early  1978  (2%  years  after  installation  of 
the  system)  to  measure  acceptance  of  AFCLAS  and  its  impacts 
perceived  by  the  hospital  staff.  This  data  collection  period 
at  MCWP  is  referred  to  as  Period  Z,  and  the  results  are 
compared  with  those  from  the  same  surveys  administered  during 
Period  Y (6  months  after  system  installation)  and  for  the  lab- 
oratory staff  during  Period  X (6  months  before  system  instal- 
lation) as  well. 


The  principal  findings  of  these  surveys  may  be  summarized 
as  follows.  Physician  acceptance  of  AFCLAS  has  increased 
from  47  percent  in  Period  Y to  86  percent  in  Period  Z,  while 
nurses'  acceptance  of  AFCLAS  has  remained  at  about  70  percent. 
Nondollar  benefits  of  AFCLAS  perceived  by  physicians  are: 
improved  patient  care,  improved  ability  to  follow  trends 
(by  providing  cumulative  reports) , improved  legibility  of 
reports,  fewer  lost  reports,  easier  retrieval  of  test  results, 
additional  patient  information,  and  improved  report  format. 

The  job  satisfaction  of  the  laboratory  staff  has  increased 
slightly  since  Period  Y,  and  the  Period  Z scores  show 


statistically  significant  differences  from  those  in  Period  X. 
Laboratory  staff  perceptions  of  working  conditions  are  con- 
siderably more  positive  than  those  in  Period  Y,  and  slightly 
more  positive  than  those  in  Period  X. 
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I.  INTRODUCTION 


This  report  presents  the  findings  of  an  evaluation  of 
hospital  staff  acceptance  of,  and  satisfaction  with,  the  Tri- 
Service  Laboratory  Information  System  (TRILAB  I)  in  use  at 
the  Medical  Center,  Wright-Patterson  (MCWP)  Air  Force  Base, 
Dayton,  Ohio.  During  design  and  implementation,  TRILAB  I 
was  referred  to  as  AFCLAS  (Air  Force  Clinical  Laboratory 
Automation  System) . Since  this  information  system  was  de- 
signed, implemented,  and  evaluated  as  an  Air  Force  project, 
it  will  be  referred  to  as  AFCLAS  in  this  report. 

The  evaluation  described  in  this  report  follows  up  a more 
comprehensive  evaluation  of  the  laboratory  information  system 
at  MCWP,  The  earlier  evaluation  included  two  periods  of  full 
scale  data  collection— one  during  manual  operation  at  MCWP 
and  one  during  operation  of  the  automated  system  (AFCLAS) , 

The  analysis  compared  the  costs  and  benefits,  both  quanti- 
tative and  qualitative,  that  were  measured  during  the  two  data 
collection  periods.  The  manual  system  data  were  collected 
during  March  1975  (referred  to  as  Period  X)  ; AFCLAS  beccime 
operational  at  MCWP  in  September  1975;  and  the  data  on  AFCLAS 
operation  were  collected  during  March  1976  (Period  Y) . 

Following  this  earlier  evaluation,  major  software  modifi- 
cations were  undertaken  to  improve  AFCLAS.  Among  these  were 
increased  memory  capacity;  online,  end-of-day  processing; 
improved  cumulative  reports;  improved  patient-sort  capabili- 
ties; and  expanded  error  messages.  The  more  limited  evaluation 
(Period  Z)  described  in  this  report  focuses  on  measuring  the 
change  since  Period  Y in  perceptions  of  AFCLAS  by  various 
hospital  groups  through  the  use  of  interviews  and  question- 
naires. The  hospital  groups  that  were  surveyed  are  physicians. 
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registered  nurses,  and  laboratory  staff.  The  survey  questions 
used  are  the  same  for  both  Period  Y and  Period  Z at  MCWP. 
Accordingly,  the  report  focuses  on  comparing  the  results  of 
Period  Y and  Period  Z interviews  and  questionnaires  (Period 
X results  are  also  presented  wherever  they  provide  additional 
insight) . 

The  data  collection  effort  for  Period  Z occurred  in  March 
1978  (except  for  physician  interviews  which  were  conducted  in 
January  1978),  Questionnaires  were  distributed  to  physicians, 
registered  nurses,  and  laboratory  staff  members.  In  addition, 
a randomly  selected  sample  of  physicians  was  interviewed  in 
depth.  Since  turnover  of  military  staff  is  high,  the  study 
was  not  restricted  to  only  those  personnel  who  were  assigned 
to  MCWP  during  Period  X or  Period  Y.  The  respondents  in 
Period  Z were  instructed  to  compare  AFCLAS  with  the  previous 
manual  system  at  MCWP  or  at  other  clinical  laboratories  where 
they  have  worked. 

The  results  of  the  physician  interviews  and  questionnaires 
are  presented  in  Section  II  of  this  report.  Sections  III  and 
IV  discuss  the  questionnaire  results  for  the  registered  nurses 
and  the  laboratory  staff,  respectively.  Section  V reviews 
the  main  findings  of  the  study  and  discusses  the  limitations 
of  the  data.  Copies  of  the  questionnaires  administered  are 
presented  in  the  Appendix.  The  areas  investigated*  and  the 
design  of  the  surveys  are  discussed  in  detail  in  the  Evaluation 
Plan  for  the  Air  Force  Clinical  Laboratory  Automation  System 
(AFCLAS)  (Reference  1) . 


*See  in  particular,  discussions  relating  to  Hypotheses  39, 

40,  and  43. 


II.  PHYSICIANS 


Physicians'  perceptions  of  AFCLAS  and  the  clinical 
laboratory  were  obtained  by  in-depth  interviews  of  a random 
sample  of  physicians  and  a multiple-choice  questionnaire 
administered  to  all  MCWP  physicians. 

A.  Physician  Interviews 

Early  in  January  1978,  a list  was  obtained  of  all  physi- 
cians assigned  to  MCWP  who  were  expected  to  be  present  for 
duty  during  the  third  week  in  January.  Physicians  assigned 
to  mental  health,  pathology,  and  radiology  were  deleted  from 
the  list  because  AFCLAS  has  little  impact  on  their  day-to-day 
clinical  practice.  A random  sample  of  25  physicians  was 
selected  from  the  revised  list,  and  physicians  were  then 
scheduled  to  meet  with  the  ANSER  interviewer.  The  interviews 
were  conducted  in  a private  office  in  the  administrative 
wing  of  the  Medical  Center  with  only  the  interviewer  and  the 
respondent  present.  The  respondents  were  assured  of  the 
impartiality  of  the  interviewer  and  of  their  own  anonymity 
in  responding. 

Twenty-three  of  the  physicians  in  the  sample  were  inter- 
viewed. One  physician  did  not  appear  for  an  undetermined 
reason.  The  other  nonrespondent  was  unable  to  appear  because 
of  an  unanticipated  need  for  his  professional  services  on  the 
interview  day. 

Six  specific  questions  were  asked  during  the  interview: 

1.  What  effect  has  AFCLAS  had  upon  your  day-to-day 
practice? 

2.  What  has  improved  since  AFCLAS? 

3.  What  has  deteriorated  since  AFCLAS? 
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4,  What  was  your  initial  reaction  to  AFCLAS? 

5,  What  is  your  present  reaction  to  AFCLAS? 

6,  What  improvements  in  AFCLAS  would  help  you  in  your 
practice? 

After  each  question  the  interviewer  used  nondirective  (neutral) 
probing  to  obtain  a more  complete  response  and  to  eliminate 
the  possibility  of  interviewer  bias.  The  length  of  the  in- 
terviews ranged  from  20  minutes  to  about  70  minutes,  with 
an  average  of  about  35  minutes.  The  responses  to  each  ques- 
tion were  categorized,  and  the  number  of  responses  in  each 
category  are  shown  in  the  tables  that  follow.  Period  Z re- 
sponses are  also  compared  with  the  responses  from  Period  Y, 

1.  Physicians'  Perception  of  the  Impact  of  AFCLAS  Upon 

Patient  Care 

The  physician  respondents  were  as)ced  to  discuss  the  impact 
of  AFCLAS  on  their  day-to-day  delivery  of  patient  care. 

Twenty  physicians  perceived  some  positive  effect  upon  their 
day-to-day  practice?  two  perceived  no  effect;  and  one  per- 
ceived a negative  effect. 

The  reason  most  often  given  for  improved  patient  care  was 
the  cumulative  report  (Table  1),  which  provides  physicians 
with  chronological  summary  statistics  on  patient  laboratory 
results.  The  second  most  popular  reason  for  improvement  in 
patient  care  was  the  provision  of  normal  values  for  test 
results  and  identification  (by  asterisk)  of  abnormal  reported 
test  values.  With  the  manual  system,  the  physician  either 
had  to  remember  the  normal  values  for  a test  or  had  to  look 
up  the  values  in  a document,  A reason  cited  by  the  physicians 
that  is  related  to  cumulative  reports  is  the  capability  of 
deriving  trends  from  the  cumulative  report.  Under  the  manual 
system,  physicians  had  to  plot  trends  by  leafing  through  the 
patient's  laboratory  reports. 
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TABLE  1 

EFFECT  OF  AFCLAS  ON  DELIVERY  OF  PATIENT  CARE- 
POSITIVE RESPONSES 


Response  Cetegury 

Number  of 
Responses 
in  Period  Z 
(N*  = 23) 

Number  of 
Responses 
in  Period  Y 
(N  * 24) 

Printing  cumulative  reports 

15 

10 

Printing  normal  values 

0 

0 

Useful  for  trend  derivation 

3 

0 

Increased  report  legibility 

2 

4 

Faster  turnaround  time  of  reports 

2 

0 

Fewer  lost  reports 

2 

4 

Easier  report  filing 

1 

0 

More  concise  reports 

1 

0 

Fewer  errors  in  reports 

1 

0 

Increased  legibility  of  charts  and  records 

0 

4 

Better  patient  identification 

0 

1 

*N  sample  size  of  respondents. 


Table  1 also  shows  a comparative  summary  of  the  responses 
from  both  periods.  Cumulative  report  printing  was  mentioned  15 
times  in  Period  Z and  10  times  in  Period  Y.  Normal  values 
were  mentioned  6 times  in  Period  Z and  were  not  mentioned  at 
all  in  Period  Y,  However,  the  automated  system  provided  cumu- 
lative reports  and  normal  values  before  both  Period  Y and 
Period  Z.  This  fact  implies  that  as  the  physician  becomes 
more  accustomed  to  the  system,  he  becomes  more  aware  of  its 
capabilities. 

The  number  of  respondents  who  found  a negative  effect  of 
AFCLAS  upon  their  delivery  of  patient  care  was  reduced  from 
three  in  Period  Y to  one  in  Period  Z;  the  number  of  those  who 
found  no  effect  of  AFCLAS  upon  patient  care  was  reduced  |] 

from  five  in  Period  Y to  two  in  Period  Z.  There  is  perhaps 
little  justification  for  comparing  respondents  in  the  Period 
Y and  Z samples  who  perceived  a negative  effect  of  AFCLAS 


upon  patient  care,  since  there  was  only  one  such  response  in 
Period  Z.  However,  the  responses  of  this  one  negative 
respondent  are  of  some  interest.  His  statements  included: 

"State  take  too  long.  The  system  is  inefficient.  There  are 
errors  in  normals.  You  cannot  trust  lab  results." 

In  summary,  when  asked  to  discussed  the  impact  of  AFCLAS 
on  their  day-to-day  practice,  more  of  the  physicians  inter- 
viewed in  Period  Z found  positive  impacts  of  AFCLAS  on  their 
delivery  of  patient  care  than  physicians  interviewed  in  Period  Y 

2.  Physicians'  Perception  of  Improvements  in  the  Clinical 

Laboratory  System  as  a Result  of  AFCLAS 

The  respondents  were  asked  what  had  improved  since  the 
introduction  of  AFCLAS.  Twenty  of  23  respondents  perceived 
improvements  due  to  AFCLAS;  three  respondents  found  no 
improvements.  Of  the  three  who  reported  no  improvements 
with  AFCLAS,  one  respondent  was  positive  toward  the  system 
when  asked  later  in  the  interview  about  his  reaction  to 
AFCLAS;  one  was  neutral  toward  the  system;  and  the  third 
respondent  was  negative. 

The  specific  responses  to  the  question  are  listed  in 
Table  2.  The  modal  response  category  in  Period  Z was  cumu- 
lative reports,  as  it  was  in  Period  Y.  The  number  of  responses 
declined  from  19  in  Period  Y to  8 in  Period  Z.  This  change 
cannot  be  explained  except  that,  possibly,  the  physicians  had 
become  so  accustomed  to  the  cumulative  report  that  they  did 
not  perceive  it  as  a major  improvement. 

Printin'^  normal  values  was  cited  four  times  in  Period  Z 
but  was  not  mentioned  at  all  in  Period  Y (Table  2) , a result 
that  is  difficult  to  explain,  since  normal  values  were  printed 
px.'ior  to  both  periods. 
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TABLE  2 

RESPONSES  ON  IMPROVEMENTS  SINCE  AFCLAS 


RttponM  Cattgory 

Number  of 
Rnponsas 
in  Period  Z 

Number  of 
Retponias 
in  Period  Y 

Printing  cumulative  reports 

8 

19 

Report  format 

6 

5 

Turnaround  time  of  results 

6 

3 

Legibility  of  reports 

5 

6 

Fewer  lost  reports 

5 

2 

Printing  normal  values 

4 

0 

Report  retrieval 

3 

7 

More  information  on  reports 

3 

Ability  to  follow  trends 

2 

Lower  error  rate 

2 

Patient  records 

1 

S(ats 

0 

Request  forms 

0 

Routine  reports 

0 

1 

The  ability  to  follow  trends  was  mentioned  by  the  physi- 
cians in  Period  Z but  not  in  Period  Y.  The  system  actually 
does  not  generate  trends;  however,  the  physician  can  follow 
trends  more  easily  with  cumulative  repKsrts  than  he  could  with 
the  manual  system's  laboratory  slips. 

Problems  with  routine  reports,  request  forms,  and  etata 
were  cited  in  Period  Y,  but  were  not  cited  in  Period  Z,  Most 
other  categories  were  cited  in  both  periods. 

In  summary,  most  improvements  due  to  AFCLAS  were  cited 
in  both  Period  Y and  Period  Z.  The  modal  category,  cumula- 
I . tive  reports,  was  the  same  for  both  periods.  The  most  sig- 

I nif leant  exception  (measured  by  the  number  of  responses)  to 

t a coninon  response  for  both  interview  periods  was  printing 

I normal  values,  which  was  cited  in  Period  Z only. 
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3.  Physicians*  Perception  of  What  Has  Deteriorated  Since 

Introduction  of  AFCIAS 

Respondents  were  asked  what  has  deteriorated  since  AFCLAS 
became  operational.  Nineteen  of  23  respondents  cited  some 
deterioration  since  AFCLAS.  Nine  of  the  19  cited  deterioration 
not  directly  related  to  AFCLAS,  for  example:  "Hard  to  get 
reports  entered.  It  is  a people  problem"  and  "The  lab  doesn't 
get  results  into  the  computer."  One  respondent  said  that 
reports  are  hand  delivered,  i.e.,  "People  don't  know  how  to 
use  the  terminals."  Other  respondents  noted:  "There  is  a 
distribution  problem"  and  "Quality  control  is  uncertain." 

In  addition  to  these  comments,  several  other  responses, 
which  were  made  in  both  Period  Y and  Period  Z and  do  not  appear 
to  be  directly  related  to  AFCLAS,  are  categorized  in  Table  3. 
These  response  categories  are:  reports  not  filed,  number  of 
lost  reports,  errors  in  input  to  the  computer,  and  laboratory 
reports  sent  to  the  wrong  place. 

The  modal  response  category  to  the  question  in  Period  Z 
was  turnaround  time  of  results  (Table  3).  The  second  most  fre- 
quent category  of  response  was  printing  wrong  normal  values. 
Because  neither  cumulative  reports  nor  normal  values  were 
provided  by  the  manual  system,  such  responses  might  be 
interpreted  as  weaknesses  of  AFCLAS  rather  than  as  general 
laboratory  deterioration.  Since  the  purpose  of  the  study  was 
to  evaluate  the  AFCLAS  system  and  its  impact  on  the  laboratory 
and  the  hospital,  it  is  any  deterioration  directly  attributable 
to  AFCLAS  that  is  significant. 

In  summary,  many  physicians  perceived  some  deficiencies 
at  the  time  of  the  interviews  in  Period  Y and  Period  Z that 
they  did  not  find  before  AFCLAS — whether  due  to  AFCLAS  directly 
or  to  laboratory/AFCLAS  interaction.  However,  fewer  Period  Z 


8 


TABLE  3 

RESPONSES  ON  DETERIORATIONS  SINCE  AFCLAS 


RMponw  CattgorY 

Niimbai  of 
Reepomn 
in  Period  Z 

Number  of 
Raaiiontat 
in  Period  Y 

Turnaround  time  of  reports 

7 

5 

Printing  wrong  normal  values 

6 

0 

Cumbersome  records 

5 

8 

Time  to  fill  out  requests 

4 

0 

Getting  results  of  specific  tests 

4 

5 

Turnaround  time  for  stats 

3 

5 

Reports  not  filed 

2 

6 

Number  of  lost  reports 

2 

5 

Errors  in  input  to  computer 

2 

3 

Laboratory  reports  sent  to  wrong  place 

2 

2 

Report  format 

1 

0 

Report  legibility 

1 

0 

Format  and  color  of  laboratory  requests 

0 

8 

Availability  of  system  for  results  inquiry 
(called  "less  downtime") 

0 

5 

Lost  specimens 

0 

4 

respondent ■ expressed  a sense  of  deterioration  than  did  Period 
Y respondents,  presumably  as  a result  of  improvements  in  both 
user  proficiency  and  system  performance. 

4.  Physicians*  Initial  and  Subsequent  Reaction  to  AFCLAS 

Physicians  were  asked  their  initial  reaction  to  AFCLAS 
and  how  their  reaction  had  evolved  to  the  present  (Period  Z). 
The  purpose  of  the  question  was  to  obtain  information  on 
physicians'  acceptance  of  AFCLAS,  It  should  be  reemphasized, 
however,  that  the  physicians  interviewed  in  Period  Z were  not 
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the  same  as  those  interviewed  in  Period  Y,  and  that  most  of 
the  Period  Z respondents  were  not  assigned  to  MCWP  during 
Period  X (manual  laboratory  operation).  In  Period  Z,  10  of 
the  23  physicians  said  they  were  initially  positive,  five 
neutral,  and  eight  negative.  Ten  respondents  reacted  in 
the  seuue  way  Initially  as  at  present  (Table  4).  Of  the  13 
whose  attitudes  changed,  10  changed  in  a positive  direction 
and  three  changed  in  a negative  direction.  Fewer  respondents 
were  initially  positive  (10)  in  Period  Z than  in  Period  Y (18), 
However,  in  Period  Y,  7 out  of  24  changed  in  a negative  direc- 
tion compared  with  the  3 out  of  23  in  Period  Z who  changed  in  a 
negative  direction. 


TABLE  4 

PHYSICIANS’  INITIAL  AND 
SUBSEQUENT  REACTION  TO  AFCLAS 


Rasponn  Catagory 

Number  of 
Responses 
in  Period  Z 

Number  of 
Responses 
in  Period  Y 

Positive  to  positive 

8 

12 

Positive  to  neutral 

0 

2 

Positive  to  negative 

2 

4 

Neutral  to  positive 

2 

2 

Neutral  to  neutral 

2 

0 

Neutral  to  negative 

1 

1 

Negative  to  positive 

5 

2 

Negative  to  neutral 

3 

0 

Negative  to  negative 

0 

1 

Total 

23 

24 

10 


* 


In  •uinmary,  considerable  change  occurred  from  Initial  to 
subsequent  reactions  in  both  Period  Y and  Period  Z,  but  more 
had  moved  in  a positive  direction  by  Period  Z (10)  than  had 
in  Period  Y (four). 

5.  Physicians*  Present  Reaction  to  AFCLAS 

Physicians  were  as)ced  their  present  reaction  to  AFCLAS 
during  interviews  in  Period  Y and  Period  Z,  If  acceptance  is 
defined  as  either  a neutral  or  positive  reaction  to  AFCLAS, 
acceptance  increased  from  18  out  of  23  respondents  in 
Period  Y (75  percent)  to  20  out  of  23  respondents  in  Period 
Z (87  percent).  Thus,  on  the  basis  of  the  interviews,  in  the 
approximately  2 years  between  Period  Y and  Period  Z,  a 
positive  change  occurred  in  physician  acceptance  of  AFCLAS. 

Specific  respondent  comments  during  Period  Z provide 
further  insight.  Statements  from  four  respondents  cate- 
gorized as  positive  include:  "Best  system  I ever  worked 
with."  "It  rapidly  changed  from  initial  problems  to  a high 
level  [of  performance]  and  has  remained  at  a high  level." 
"Beneficial  in  a medical  center."  "It  is  a good  system."  Four 
of  the  neutral  responses  were:  "Tolerable. . .can  live  with 
it."  "It's  here... have  to  put  up  with  it."  "Like  it  sometimes, 
dislike  it  sometimes."  "Finally  it's  going  and  it's  pretty 
nice."  Negative  responses  included:  "Doesn't  work.  Worth- 
while to  pursue  the  idea."  "It  is  inefficient."  "The  system 
is  useless." 

The  responses  reflect  a wide  range  of  opinion.  The  com- 
ments during  Period  Z of  those  who  were  negative  were  not  as 
strong  as  some  comments  made  during  Period  Y when,  for  example, 
one  respondent  had  said,  "Burn  the  computer."  During  Period  Z, 
no  one  suggested  getting  rid  of  the  computer.  The  data  thus 
imply  that  although  the  degree  of  enthusiasm  for  the  system 
varies,  almost  all  physicians  generally  accept  it.  Of  the 
three  who  were  negative,  one  was  a qualified  negative. 
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6,  Improvements  in  AFCIAS  That  Would  Help  Physicians 


The  respondents  were  asked  what  improvements  in  AFCLAS 
would  help  them  in  their  daily  medical  practice.  There  were 
some  comments  related  to  personnel  rather  than  AFCLAS,  but 
only  one  personnel  category  was  mentioned  more  than  once. 

That  category  was  "better  training."  Comments  mentioned 
only  once  each  were:  "Full-time  manager";  "Better  lab 
personnel";  "A  specific  person  in  the  lab  to  respond  to  a 
physician's  inquiry."  This  is  in  contrast  with  Period  Y 
when  three  categories  of  personnel  responses  were  mentioned 
t%#o  or  more  times,  and  four  others  were  each  cited  once. 

This  suggests  that  although  there  are  still  personnel  prob- 
lems, they  were  not  as  significant  in  Period  Z as  they  were 
in  Period  Y. 

The  modal  response  category  was  "more  terminals"  (see 
Table  5),  as  was  the  case  in  Period  Y;  however,  the  number  of 
physicians  in  the  category  increased  from  7 in  Period  Y to 
10  in  Period  Z,  "Faster  turnaround  time  of  results"  was  the 
second  most  frequent  response,  and  "better  way  to  enter  data" 
was  the  third.  In  Period  Y the  only  response  categories  cited 
more  than  twice  were  "more  terminals"  and  "better  format  and 
color  of  request  forms."  Table  5 clearly  indicates  more 
consensus  in  Period  Z than  in  Period  Y. 

In  summary.  Period  Z respondents  expressed  more  unified 
opinions  on  what  would  improve  AFCLAS.  The  modal  response 
(more  terminals)  does  not  call  for  any  changes  in  the  basic 
system — merely  additions  to  the  system.  For  the  most  part, 
the  other  categories  in  Table  5 are  Improvements  to  the  hard- 
ware and  software  systems.  In  addition,  some  improvements 
in  the  personnel  area  were  suggested. 
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TABLE  5 

PHYSICIANS’  SUGGESTIONS  FOR  IMPROVEMENT  TO  AFCLAS 


Rtsponst  Cattgoty 

Number  of 
Responses 
in  Period  Z 

Number  of 
Responses 
rn  Period  Y 

Mora  terminals 

10 

7 

Faster  turnaround  time  of  results 

7 

2 

Better  way  to  enter  data 

5 

0 

CRT  and  printer 

2 

2 

Data  retrievable  for  longer  per  rod 

2 

2 

Simpler  retrieval 

2 

2 

Less  downtime 

2 

1 

CRT  instead  of  printer 

2 

0 

Faster  terminals 

1 

1 

Mora  background  rntormatrun  on  patrent 

1 

1 

Identification  of  patient's  military  base 

1 

1 

Report  of  trends 

1 

1 

Report  of  patient  medication 

1 

0 

Easier  report  filing 

1 

0 

Elimrnation  of  prrnting  nornral  values 

1 

0 

Better  format  and  color  of  request  forms 

0 

3 

Capabriity  to  change  system  at  local  level 

0 

2 

Better  distribution  system 

0 

2 

Need  for  backup  system 

0 

1 

More  cortcise  reports 

0 

1 

Capability  to  provide  more  specrfic 
directions  to  the  laboratory 

0 

1 

B.  Physician  Questionnaires 

The  Physician  Questionnaire  (see  Appendix)  is  designed 
to  measure  physician  acceptance  and  perceived  impacts  of 
AFCLAS  when  compared  with  the  previous  manual  system.  All 
115  physicians  surveyed  completed  the  questionnaire  in  Period 
Z.  In  this  analysis  we  assume  that  Responses  1 and  2 to  a 
question  imply  a perceived  positive  impact  of  AFCLAS,  Response 
3 implies  no  perceived  impact,  and  Responses  4 and  5 imply  a 
perceived  negative  impact. 

An  average  of  20  percent  of  the  physicians  expressed  no 
opinion  about  any  given  question  in  Period  Z compared  with 
an  average  of  8 percent  in  Period  Y.  These  percentages  suggest 
that  in  Period  Z (after  an  additional  2 years  of  computer 
operations  since  Period  Y) , fewer  physicians  were  familiar 
with  the  previous  manual  laboratory  system,  as  would  be 
expected.  In  fact,  the  responses  to  Question  33  indicate 
that  only  29  of  the  115  physicians  (27  percent)  surveyed 
in  Period  Z were  assigned  to  MCWP  during  Period  Y,*  The 
responses  of  the  29  physicians,  however,  were  found  to  be 
very  similar  to  those  of  the  86  physicians  assigned  since 
Period  Y;  therefore,  all  115  responses  are  presented  together. 
Thirty-four  percent  of  the  physicians  (39  out  of  115)  indi- 
cated on  Question  34  that  they  had  worked  with  an  automated 
laboratory  system  before  coming  to  MCWP. 

Table  6 presents  the  results  by  question  for  both  Period 
Y and  Period  Z,  The  data  indicate  a substantial  improvement 
in  physician  acceptance  of  AFCLAS  and  in  their  perception  of  its 
performance  since  Period  Y«  Question  5 asks  the  physicians 


•No  separate  analyses  were  performed  for  the  subset  of  phy- 
sicians, nurses,  and  laboratory  staff  who  were  assigned  to 
MCWP  during  all  three  data  collection  periods,  since  in  each 
case  the  number  of  respondents  was  fewer  than  15. 
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to  make  an  overall  comparison  between  AFC LAS  and  the  manual 
system.  The  results  for  all  physicians,  omitting  responses 
of  "no  opinion"  and  blanks  (35  in  Period  Z and  10  in  Period 
Y) , are: 

Period  Y Period  Z 

AFCLAS  Superior  to  Manual  System  32  percent  66  percent 

AFCLAS  No  Different  From  Manual 

System  15  percent  20  percent 

AFCLAS  Inferior  to  Manual  System  53  percent  14  percent 


After  6 months  of  computer  operations  in  the  laboratory,  (i.e., 
during  Period  Y)  the  majority  of  physicians  at  MCWP  felt  that 
the  manual  system  was  better;  however,  after  30  months  of 
computer  operations  (i.e,,  during  Period  Z)  the  majority  pre- 
ferred AFCLAS  to  the  manual  system.  If  we  define  acceptance 
of  AFCLAS  by  physicians  as  the  percent  who  consider  AFCLAS  to 
be  at  least  as  good  as  the  previous  system,  then  based  on 
Question  5 physician  acceptance  of  AFCLAS  increased  from 
47  percent  in  Period  Y to  86  percent  in  Period  Z.  This 
reversal  of  opinion  is  similarly  reflected  in  the  responses 
to  Question  12  on  the  overall  efficiency  of  the  laboratory. 

In  Period  Y,  most  physicians  (63  percent)  felt  that  the 
laboratory  functioned  more  smoothly  under  the  manual  system, 
whereas  in  Period  Z,  the  majority  (51  percent)  perceived 
smoother  laboratory  operations  under  AFCLAS. 

The  results  presented  in  Table  6 show  that  in  Period  Z, 
on  most  questions  a majority  of  physicians  perceived  a 
positive  AFCLAS  impact  and  that  no  question  evoked  a majority 
who  perceived  a negative  AFCLAS  impact.  The  magnitudes  of  posi- 
tive agreement  varied  greatly  among  questions,  however,  and 
Table  7 orders  the  questions  according  to  the  percent  who 
responded  positively. 
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TABLE  6 

PHYSICIAN  QUESTIONNAIRE  RESPONSES 


*Th«  chtng*  in  pamntag*  ot  poiitiv*  rMDoniM  from  Pvciod  Y to  Patiod  Z i>  ttatislicaKv  iigniticant  at  ttt*  0.05  (•val 
for  Mch  quMtion  *xc«ot  QuMtion  <6  and  QuMtion  26. 

^Ovar  50  parcant  of  tha  opinad  ratpontat  aia  favorabla  (f ),  no  cPanga  (01.  ot  nagativa  (-1. 


G 


TABLE  7 

RESPONSES  DURING  PERIOD  Z ON  PHYSICIAN  QUESTIONNAIRE- 
PERCENTAGE  DISTRIBUTION 


Piretntaft 

Pamiviiii  Posithe 
AFCLAS  ImpKt 

Question 

Numbers 

ImpKt 

Area 

80  or  mort 

7,  24,  25, 30 

Retrieval  of  Results 

Report  Legibility 

Need  to  Telephone 

Cumulative  Reports 

70  to  79 

3, 10, 15, 18 

Amount  of  Statistical  Information 
Report  Format 

60  to  69 

4,5.  17,20 

Amount  of  Patient  Information 
Overall  Comparison 

Data  Utility 

Retrieval  of  Results 

50  to  59 

1.6,9,12, 

22,27,31 

Quality  of  Care 

Request  Accuracy 

Lab  Efficiency 

Completeness  of  Filing 

Physician  Time 

No  Positive  Consensus 

2.8.11.13, 

14, 16, 19, 
21,23,  26, 
28,29 

Stat  Report  Response  Time 

Report  AccufKy 

Confidence  in  Report  Data 

Routine  Report  Response  Times 
Telephone  Retrieval 

Physician-Lab  Relations 

Calls  or  Visits  to  Lab 

Eighty  percent  or  more  of  the  physicians  who  expressed 
opinion  felt  that  AFCLAS  improved  test  result  retrieval 
and  report  legibility,  reduced  their  need  to  telephone  the 
laboratory,  and  improved  laboratory  service  with  the  intro- 
duction of  cumulative  reports.  Seventy  to  79  percent  of 
physicians  perceived  improvements  due  to  AFCLAS  in  the  amount 
of  statistical  information  provided  and  in  the  format  of 
laboratory  reports.  Improvements  in  the  amount  of  patient 
information,  the  utility  of  laboratory  data  to  physicians 
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and  the  speed  with  which  test  results  were  retrieved  were 
attributed  to  AFCLAS  by  60  to  69  percent  of  physicians. 

A majority  agreed  (though  not  a large  majority)  that  AFCLAS 
positively  impacted:  the  contribution  of  the  laboratory  to 
the  quality  of  patient  care  (52  percent) , the  accuracy  of  test 
requests  (53  percent),  the  efficiency  of  the  laboratory  (51 
percent),  the  completeness  of  report  filing  (55  percent),  and 
physician  time  spent  obtaining  and  using  laboratory  reports 
(51  percent) ; and  that  AFCLAS  had  no  impact  on:  the  accuracy 
of  reports  (57  percent),  stat  report  turnaround  time  (55 
percent) , and  relations  between  physicians  and  the  laboratory 
staff  (51  percent). 

The  average  percentage  who  perceived  a positive  AFCLAS 
impact  for  each  question  rose  from  33  in  Period  Y to  55  in 
Period  Z,  and  the  increase  was  statistically  significant  at 
the  0.05  level  for  each  question  except  Question  16  (waiting 
time  for  routine  reports)  and  Question  26  (number  of  telephone 
calls  for  results) . 

In  summary,  AFCLAS  was  accepted  (as  defined  here)  by  86 
percent  of  physicians  at  MCWP  in  Period  Z compared  with  47 
percent  in  Period  Y.  Physicians  perceived  many  more  positive 
impacts  of  the  system  after  2%  years  of  operation  than  they 
had  reported  after  its  first  6 months.  The  improvement  in  the 
physician  assessment  of  AFCLAS  may  be  attributed  to  such 
factors  as  the  modifications  made  to  the  system  between  Period 
Y and  Period  Z,  the  additional  2 years  of  familiarity  with 
computerized  operations,  general  improvements  in  laboratory 
operations,  and  the  high  proportion  of  physicians  newly 
assigned  to  MCWP  and  hence  less  fauniliar  with  the  previous 
manual  system  (and  in  many  cases,  more  familiar  with  automated 
procedures) . 
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Nondollar  Benefits 


Because  physicians  are  the  primary  users  of  laboratory 
reports,  their  questionnaire  and  interview  responses  form 
the  basis  for  assessing  nondollar  benefits.  For  the  inter- 
views, nondollar  benefits  were  established  by  taking  those 
responses  from  Table  1 mentioned  three  or  more  times  by  physi- 
cians in  Period  Z,  and  those  responses  from  Tables  2 and  3 in 
which  a net  direction  of  an  AFCLAS  impact  was  perceived  by 
three  or  more  interviewed  physicians.  For  ex6unple,  five  phy- 
sicians in  Period  Z reported  that  the  frequency  of  lost  reports 
decreased  since  AFCLAS  (Table  2),  and  two  felt  that  the  fre- 
quency increased  (Table  3).  Therefore,  the  category  of  lost 
reports  is  included  in  this  analysis  as  having  improved, 
based  on  the  interviews. 


For  the  questionnaires,  the  percentages  in  Table  6 were 
used  to  determine  whether  the  impact  area  addressed  by  each 
question  improved,  remained  the  same,  or  deteriorated  (based 
on  plurality  of  responses)  with  the  installation  of  AFCLAS. 
The  results  of  nondollar  benefits  from  the  questionnaires 
(summarized  in  Table  6)  are  presented  more  fully  below: 


Patient  Care 
Question  1 
Question  8 
Question  9 
Question  10 
Question  13 
Question  14 
Question  17 


Favorable 

Unchanged 

Favorable 

Favorable 

Unchanged 

Unchanged 

Favorable 


Overall  Improvement* 


*The  overall  assessments  were  made  on  the  basis  of  a subjec- 
tive weighting  of  the  relative  importance  of  each  question. 
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e 

Cumulative 

Reports 

Question 

30 

Favorable 

Overall  Improvement 

Question 

22 

Favorable 

Question 

31 

Favorable 

Overall  Improvement 

e 

Legibility 

of  Reports 

Question 

24 

Favorable 

Question 

25 

Favorable 

Overall  Improvement 

e 

Turnaround 

Time  for  Routine 

Reports 

Question 

16 

Unchanged 

No  Overall  Impact 

e 

Turnaround 

Time  for  Stat  Reports 

Question 

21 

Unchanged 

No  Overall  Impact 

e 

Retrieval  of  Test  Results 

Question 

7 

Favorable 

Question 

19 

Favorable 

Question 

20 

Favorable 

Question 

27 

Favorable 

Overall  Improvement 

e 

Report  Format 

Question 

10 

Favorable 

Question 

15 

Favorable 

Question 

18 

Favorable 

Overall  Improvement 

• 

Accuracy  of 

Test  Results 

Question 

2 

Favorable 

Question 

6 

Favorable 

Question  11  Unchanged 

Question  14  Unchanged 

No  Overall  Impact 
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1 


• Amount  of  Patient  Information 

Question  3 Favorable 

Question  4 Favorable 

Overall  Improvement 

The  results  for  both  survey  instruments  and  from  both 
Period  Y and  Period  Z are  summarized  in  Table  8.  In  Period 
Z,  physicians  perceived  an  improvement  in  14  instances  and 
no  net  impact  in  6 instances,  compared  with  Period  Y where 
improvements  were  perceived  in  13  instances  and  deteriorations 
in  7 instances o The  impacts  derived  from  the  questionnaire 
match  those  derived  from  the  interviews  in  Period  Z but  dis- 
agree in  three  instances  in  Period  Y. 

Table  8 suggests  that  after  2%  years  of  computer  operation, 
physicians  were  more  consistent  in  their  perceptions  of  the 
nondollar  impacts  of  AFCLAS  than  they  were  after  its  first  6 
months  of  operation  and  were  considerably  less  negative  in 
their  assessments.  The  physicians  continued  to  perceive  no 
positive  AFCLAS  impact  on  the  turnaround  time  for  either  rou- 
tine or  atat  reports  and  no  positive  impact  on  the  accuracy  of 
reports,  but  they  did  perceive  improvements  or  benefits  from 
AFCLAS  in  the  other  seven  nondollar  areas. 
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TABLE  8 

SUMMARY  OF  THE  AFCLAS  NONDOLLAR  BENEFITS  IDENTIFIED 

BY  PHYSICIANS 


Ill 


REGISTERED  NURSES 


A multiple-choice  questionnaire  similar  to  the  one  com- 
pleted by  physicians  was  administered  to  registered  nurses 
at  MCWP  during  both  Period  Y and  Period  Z.  Operating  room 
nurses,  nurse  practitioners,  and  nurse  anesthetists,  who 
were  affected  very  little  by  AFCLAS,  were  not  included  in 
the  survey.  The  questionnaire  (see  Appendix)  was  designed 
to  measure  nurses'  acceptance  of  AFCLAS  and  their  perception 
of  its  impacts.  In  this  analysis  we  assume  that  Responses 
1 and  2 to  a question  imply  a perceived  positive  impact  of 
AFCLAS,  Response  3 implies  no  perceived  impact,  and  Respon- 
ses 4 and  5 imply  a perceived  negative  impact.  In  Period 
Y,  73  nurses  (94  percent  of  those  surveyed)  completed  the 
questionnaire,  and  in  Period  Z all  112  nurses  surveyed  (100 
percent  response  rate)  completed  the  questionnaire.  Seven 
recently  assigned  nurses  in  each  period  returned  a blank 
questionnaire  with  a note  explaining  their  unfamiliarity 
with  AFCLAS,  and  were  excluded  from  the  target  population. 

Table  9 presents  the  results  for  each  of  the  questions. 
There  is  no  statistically  significant  change  in  the  percentage 
of  positive  responses  from  Period  Y to  Period  Z for  any  of  the 
questions.  Overall,  less  than  one-third  of  the  nurses  were 
favorable  in  their  evaluation  of  AFCLAS  in  both  periods.  Ques- 
tion 7 asks  nurses  to  make  the  same  overall  comparison  between 
AFCLAS  and  the  previous  system  (or  a manual  system  with  which 
they  were  familiar)  that  was  asked  of  physicians.  The  results 
for  all  nurses,  omitting  "no  opinion"  responses  and  blanks 
(36  in  Period  Z and  11  in  Period  Y) , are: 


AFCLAS  Superior  to  Manual  System 

AFCLAS  No  Different  From  Manual 
System 

AFCLAS  Inferior  to  Manual  System 


Period  Y 
31  percent 

43  percent 
26  percent 


Period  Z 
30  percent 

38  percent 
32  percent 


If  acceptance  of  AFCLAS  is  defined  as  the  percentage  of  j 

I respondents  who  consider  AFCLAS  at  least  as  good  as  the 

I 

j previous  system,  nurses'  acceptance  of  the  automated  system 

! decreased  from  74  percent  in  Period  Y to  68  percent  in  | 

I Period  Z.  Although  this  decrease  is  not  statistically  sig-  ] 

j nif leant  at  the  0.05  level,  we  can  safely  conclude  that  ' 

acceptance  of  AFCLAS  by  nurses  (as  defined  above)  did  not 
increase  after  the  additional  2 years  of  computer  opera- 
tions at  MCWP  since  in  both  time  periods  a virtually  com- 
plete census  of  nurses  was  obtained  (as  opposed  to  sampling) . 

Table  9 also  shows  that  in  general  fewer  nurses  agreed  on 
the  direction  of  the  computer  impacts  than  did  physicians.  In 
Period  Z,  a majority  of  nurses  did  agree,  however,  that  with 
AFCLAS  the  legibility  of  reports  had  improved  (73  percent 
favorable),  that  posting  of  reports  in  the  patient's  chart 
was  easier  (72  percent) , that  the  organization  of  specimen 
collection  was  unchanged  (57  percent),  that  telling  what 
laboratory  work  will  be  performed  on  a given  day  was  neither 

easier  nor  harder  (58  percent) , that  scheduling  patients  for  | 

laboratory  tests  was  neither  easier  nor  harder  (64  percent) , ' 

and  finally,  that  the  nursing  time  spent  in  clerical  work 
relating  to  laboratory  reports  had  increased  (54  percent) . 

More  nurses  perceived  a negative  impact  of  AFCLAS  on  the  time 
spent  on  laboratory-related  tasks  (Question  1 through  Question 
4)  than  perceived  either  a positive  impact  or  no  change,  which 
may  explain  their  continued  low  level  of  AFCLAS  acceptance. 

Table  9 also  shows  that  in  Period  Z,  one-fourth  of  all  responses 
were  "no  opinion"  (compared  with  the  one-fifth  for  physicians) , 
perhaps  suggesting  that  nurses  are  less  involved  in  the  lab-  ' 

oratory  computer  tasks  than  are  physicians. 

In  summary,  the  positive  assessment  of  AFCLAS  by  physicians 
is  not  shared  by  the  nursing  staff,  whose  opinions  have  remained 
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TABLE  9 

REGISTERED  NURSE  QUESTIONNAIRE  RESPONSES 


Th*  in  o«ro«nt»^  ijf  'tto'X'wi  frorr)  Pe^-nyl  < to  Peticrt  Z n not  ttatitticadv  wgnifieant  »;  tti*  0.06  '•vtt  for  jny  Qu*tTiori 

r 

Ow  50  W'Jir'r  of  f»i*  ocn^S  tapontei  *<■«  *»vo«'*6<«  <♦),  no  I0>,or  n«g»T)w»  ( -) 


fairly  constant  since  the  system's  first  year  of  operation. 
Four  out  of  five  nurses  found  no  reduction  in  the  amount  of 
time  spent  in  clerical  work  relating  to  laboratory  reports 
since  AFCLAS,  and  over  half  of  the  nurses  perceived  an  in- 
crease in  clerical  work  due  to  AFCLAS.  The  automated  system 
is  acceptable,  however,  to  both  physician  and  nursing  staffs 
at  MCWP.  After  6 months  of  operation  the  nurses'  evaluations 
of  AFCLAS  were  more  favorable  than  those  of  physicians,  but 
after  2^  years  of  computer  operations,  nursing  acceptance 
had  remained  at  about  70  percent  while  physician  acceptance 
had  increased  from  47  percent  to  86  percent.  Improved  legi- 
bility of  reports  due  to  AFCLAS  was  perceived  by  the  highest 
percentage  of  respondents  for  both  physicians  (95  percent) 
and  nurses  (73  percent) . 
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IV.  LABORATORY  STAFF 


The  laboratory  staff  completed  identical  questionnaires 
in  Periods  X,  Y,  and  Z containing  questions  about  their 
general  satisfaction  with  their  jobs  and  with  laboratory 
operations.  Period  X data  are  thus  included  in  the  analysis 
that  follows.  Technicians,  students,  and  administrative 
personnel  working  in  the  clinical  laboratory  during  any  of 
the  data  collection  periods  were  included  in  the  study, 
while  commissioned  officers,  secretaries,  and  volunteers 
were  excluded.  Questionnaires  (see  Appendix)  were  completed 
by  the  entire  target  population  in  each  time  period,  yield- 
ing 53  respondents  in  Period  X,  61  in  Period  Y,  and  69  in 
Period  Z.  Part  1 of  the  questionnaire  is  a job  satis- 
faction scale  that  asked  respondents  to  indicate  the  extent 
of  their  agreement  with  each  of  23  statements  about  their 
jobs.  Part  2 posed  12  specific,  multiple  choice  questions 
about  clinical  laboratory  operations. 

A total  score  on  the  job  satisfaction  scale  was  computed 
for  each  respondent.  From  these  we  obtained  the  mean  scores 
for  Periods  X,  Y,  and  Z and  conducted  a statistical  signif- 
icance test  on  the  difference  between  means  for  Period  Y and 
Period  Z,  and  for  Period  X and  Period  Z. 

To  score  the  job  satisfaction  questionnaire  we  assigned 
numerical  values  from  1 to  5 to  the  responses  to  each  ques- 
tion— from  "strongly  agree,”  which  was  assigned  a value  of  1, 
to  "strongly  disagree,”  which  was  assigned  a value  of  5.  We 
then  summed  the  scores  for  the  23  questions  on  the  scale  to 
obtain  an  overall  score.  A lower  total  score  indicates  greater 
job  satisfaction. 

The  mean  score  in  Period  Z was  54.0  with  a standard  devia- 
tion of  9.4,  compared  to  55.2  in  Period  Y (standard  deviation 
« 9.1)  and  58.4  in  Period  X (standard  deviation  « 8.3).  Job 


satisfaction  scores  improved  from  before  AFCLAS  to  after  AFCLAS 
and  the  difference  between  the  Period  X and  Period  Z scores 
is  statistically  significant  at  the  0.05  level  (t  test  with  82 
degrees  of  freedom) . The  proportion  of  all  Part  1 responses 
that  were  either  "strongly  agree"  or  "agree"  was  66  percent 
in  both  Period  Y and  Period  Z and  was  not  significantly  lower 
(63  percent)  in  Period  X.  The  data  indicate  that  while  job 
satisfaction  of  the  laboratory  staff  showed  some  improvement 
over  time,  the  percentage  satisfied  remained  virtually 
unchanged.  This  is  certainly  possible  since  computing  the 
percentage  satisfied  results  in  a dichotomization  of  the 
data  and  a subsequent  reduction  in  sensitivity  to  measuring 
change.  Also,  AFCLAS  may  have  caused  some  technicians' 
jobs  to  be  easier  while  causing  other  jobs  to  be  more  diffi- 
cult or  less  enjoyable  as  reflected  in  the  increasing  variance 
of  the  satisfaction  scores  over  time,  although  the  difference 
in  the  variances  of  Period  X and  Period  Z scores  is  not 
statistically  significant  at  the  0.05  level  (F  test  with  68 
and  52  degrees  of  freedom) . 

Table  10  displays  for  each  of  the  23  statements  on  the 
job  satisfaction  scale,  the  percentage  of  respondents  who 
agreed  (responded  "agree"  or  "strongly  agree").  The  percent- 
age of  responses  to  Statement  10  ("Dealing  with  other  people 
in  the  laboratory  is  an  important  part  of  my  job.")  and  State- 
ment 11  ("The  laboratory  is  a great  place  to  develop  close 
friends."),  increased  significantly  between  Period  X and 
Period  Z.  However,  neither  of  these  response  changes  can  be 
directly  related  to  AFCLAS  implementation.  There  are  no 
statistically  significant  changes  in  the  percentage  who  agreed 
with  any  job  satisfaction  statement  between  Period  Y and 
Period  Z. 
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Table  11  presents  the  results  for  Part  2 of  the  question- 
naire. Percentages  are  shown  for  Responses  1,  2,  and  3 to 
enable  a test  for  statistically  significant  differences  in 
proportions  between  Period  Z and  both  Period  X and  Period  Y. 

For  most  of  the  10  tabulated  questions  this  dichotomization 
results  in  a clear  separation  of  the  desirable  and  undesirable 
response  categories.  Question  1 asked  respondents  what  was 
the  normal  workweek  in  the  laboratory.  Before  AFCLAS,  in 
Period  X,  most  of  the  laboratory  staff  (79  percent)  reported 
a workweek  of  under  45  hours.  After  6 months  of  computer 
operations  (i.e.,  during  Period  Y) , less  than  half  (48  percent) 
perceived  an  average  of  under  45  hours  per  week,  even  though 
the  size  of  the  laboratory  staff  had  increased  15  percent. 

In  Period  Z,  however,  87  percent  perceived  the  normal  work- 
week as  under  45  hours,  a portion  somewhat  greater  than  that 
in  Period  X and  nearly  double  that  (48  percent)  in  Period  Y. 
Questions  2,  3,  and  5,  also  related  to  hours  worked,  had  the 
same  pattern  of  change,  though  less  pronounced,  over  the 
three  time  intervals.  In  Period  Z,  47  percent  of  the  staff 
reported  recent  overtime  (Question  5)  compared  with  76  percent 
in  Period  Y and  59  percent  in  Period  X. 

With  the  exception  of  Question  10,  which  asks  the  respon- 
dent to  compare  the  quality  of  laboratory  reports  at  MCWP  with 
that  of  reports  in  similar  laboratories,  Questions  6 through 
12  reflect  the  extent  to  which  the  staff  feel  they  have  enough 
time  to  work  effectively.  The  responses  to  all  six  questions 
exhibit  the  same  pattern  of  change  over  time,  a pattern  con- 
sistent with  that  found  in  the  workweek  category.  In  Period 
Z,  the  majority  of  respondents  (57  percent)  felt  they  had  enough 
time  to  accomplish  their  tasks  (Question  6) ; only  26  percent 
felt  that  way  in  Period  Y and  49  percent  in  Period  X, 
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31 


The  responses  to  Question  10  indicate  that  the  perceived 
quality  of  laboratory  reports  at  MCWP  deteriorated  somewhat 
after  the  first  6 months  of  automation  but  in  Period  Z had 
returned  to  the  high  level  observed  before  AFCLAS  installation. 

The  results  of  the  laboratory  staff  survey  in  Period  Z 
show  a slight  improvement  in  job  satisfaction  and  staff  per- 
ceptions of  working  conditions  since  Period  X.  While  in 
most  cases  this  improvement  is  not  statistically  significant, 
the  deterioration  in  staff  perceptions  of  working  conditions 
observed  after  AFCLAS*  first  6 months  of  operation  (i.e., 
during  Period  Y]  has  now  been  reversed  (on  the  basis  of  Part 
2 responses)  and  the  differences  between  Period  Y and  Period 
Z are  highly  significant. 
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V.  CONCLUSIONS 


The  surveys  administered  for  this  evaluation  in  Periods  X, 
Y,  and  Z were  used  to  measure  changes  in  acceptance  of  AFCLAS 
and  in  perceptions  of  clinical  laboratory  operations  by 
physicians,  nurses,  and  the  laboratory  staff.  The  principal 
findings  of  these  surveys  may  be  summarized  as  follows: 

• Physician  acceptance  of  AFCLAS  has  substantially  in- 
creased (from  47  percent  to  86  percent)  between  the 
two  periods  according  to  the  questionnaire  results, 
but  has  moderately  increased  (from  75  percent  to  86 
percent)  from  Period  Y to  Period  Z according  to  the 
interview  results.  Since  the  questionnaires  were 
completed  by  the  entire  target  population  of  physicians, 
we  can  conclude  that  physician  acceptance  has  increased 
to  a high  level  since  Period  Y.  The  benefits  of  AFCLAS 
perceived  most  often  by  physicians  are  the  provision 

of  cumulative  reports,  improved  legibility  of  reports, 
and  improved  retrieval  of  results.  Their  suggestions 
for  improvements  to  the  system  centered  on  more  ter- 
minals, faster  turnaround  time  of  results,  and  better 
ways  to  enter  data. 

• Nurses'  acceptance  of  AFCLAS  has  remained  at  about  70 
percent  since  Period  Y.  The  benefits  of  AFCLAS  per- 
ceived most  often  by  nurses  are  improved  legibility 

of  results  and  easier  posting  of  the  laboratory  reports 
in  the  patient's  chart. 

• The  job  satisfaction  of  the  laboratory  staff  has  in- 
creased slightly  since  Period  Y,  and  the  Period  Z scores 
show  statistically  significant  differences  from  those 

in  Period  X.  Laboratory  staff  perceptions  of  working 
conditions  are  much  more  favorable  than  they  were  in 
Period  Y and  slightly  more  favorable  than  in  Period  X. 
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While  we  believe  we  have  euccesefully  measured  the  chanqett 
that  have  occurred  since  APCLAS  was  introduced  at  MCWP,  a 
nximber  of  factors  make  it  difficult  to  draw  conclusions  about 
the  primary  causes  of  those  changes.  Most  of  the  respondents 
to  the  four  questionnaires  in  Period  Z,  for  example,  were  not 
assigned  to  MCWP  during  manual  operation  of  the  laboratory, 
and  also,  the  surveys  were  not  designed  to  isolate  the  impacts 
of  the  software  modifications  implemented  between  Period  Y 
and  Period  Z.  As  a result,  we  do  not  know  how  much  of  the 
change  observed  between  these  periods  is  due  to  the  modifi- 
cations (listed  on  page  1)  and  how  much  is  due  to  changes  in 
staff  familiarity  with  automated  information  procedures. 

An  observation  that  supports  the  validity  of  our  findings 
is  that  the  level  of  acceptance  of  AFCLAS  and  the  direction 
of  its  impacts  perceived  by  the  hospital  staff  at  MCWP  in 
Period  Z correspond  closely  to  staff  perceptions  of  a similar 
automated  system  at  Malcolm  Grow  Medical  Center  (MGMC) , Andrews 
Air  Force  Base  (Reference  2).  This  observation  is  based  on 
the  responses  to  similar  questionnaires  administered  2 years 
after  system  implementation  at  MGMC.  Physician  acceptance,* 
for  example,  was  about  85  percent  after  2 years  of  operation 
at  MGMC  and  after  2^  years  at  MCWP.  In  addition,  18  of  the 
19  positive  impacts  of  AFCLAS  observed  by  a majority  of 
physicians  at  MCWP  (see  Table  6)  wore  also  reported  by  a 
majority  of  physicians  at  MGMC. 

While  only  subjective  data  were  obtained  during  Period  Z, 
the  performance  of  AFCLAS  at  MCWP,  particularly  relating  to 
physicians,  seems  to  have  improved  considerably  since  its 
first  6 months  of  operation. 


* Physician  acceptance  is  defined  as  the  percentage  who  con- 
sider the  automated  system  to  be  at  least  as  good  as  the 
previous  manual  system. 
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APPENDIX 


QUESTIONNAIRES 


1 


Th«  schedules  (questionnaires)  in  this  appendix  were 
designed  to  measure  attitudes  toward  the  clinical  laboratory 
and  acceptance  of  AFCLAS. 
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rHYSlClMt'S  tfUCSTIONNAIRE 


Instructions 

1.  Complat*  ths  qusstionnsirs  on  the  besis  of  your  knowledge  and  personal  enperience  with  the  clinical 
laboratories  at  the  Wriqht-Patterson  Medical  Center  and  other  clinical  laboratories  (Air  Force  and 
non-Alr  Force) . 

2.  A Clinical  Laboratory  Automation  System  (AFCLAS)  was  installed  at  the  Wriqht-Patterson  Medical 
Cantor  2 years  ago.  Me  would  like  to  know  your  opinion — as  a practicing  physician — of  the  Impact  AFCLAS 
has  had  on  your  professional  activities. 

1.  Finally,  insert  the  completed  questionnaire  in  ths  accompanying  envelope,  seal  the  envelope,  and 
print  the  following  information  on  the  front  of  the  envelope: 

Name 

Department . 


This  information  will  be  used  only  to  ensure  that  responses  from  all  physicians  at  Hright-Pattarson 
Medical  Canter  will  be  included  in  the  study.  The  sealed  envelope  will  be  opened  only  by  the  research 
team  of  Analytic  Services  Inc.  (ANSER) , and  tha  information  you  provide  will  be  available  only  to 
the  team. 


ANSIA 

W-P,  March  197S 


1 . ArCLAS  has 


II  (Ignif icantly  incraased 
I)  allghtly  Incraaacd 
II  had  no  a f fact  on 
II  slightly  dacraaaad 
II  significantly  dacraaaad 

1 1 No  opinion 

2 . AFCLAS  has 


tha  quality  of  patiant  cars. 


II  virtually  aliminatad 
II  slightly  raducad 
n had  no  affact  on 
1 1 slightly  increaaad 
II  significantly  incraasad 

1 1 No  opinion 


arrors  in  clinical  laboratory  raports. 


i.  AFCLAS  has  providad 


1 1 much  mora 

II  slightly  stora 

11  about  tha  sama  amount  of 

(I  slightly  lass 

(I  significantly  lass 

1 1 No  opinion 


statistical  information. 


4.  AFCLAS  has 

(I  significantly  incraasad 
II  slightly  incraasad 
[I  had  no  affact  on 
(I  slightly  dacraasad 
II  significantly  dacraasad 

I I No  opinion 

5.  AFCLAS  is 


tha  amount  of  information  availabla  from  clinical 
laboratory  raports. 


(I  far  suparior  to 
II  slightly  suparior  to 
II  about  tha  sama  quality  as 
(I  slightly  infarior  to 
1 1 far  infarior  to 

1 1 No  opinion 


^ tha  pravious  systam. 


6.  AFCLAS  is 


[I  far  suparior  to 
(I  slightly  suparior  to 
11  about  tha  sasm  as 
(I  slightly  infarior  to 
II  significantly  infarior  to 

1 1 No  opinion 


tha  pravious  systam  in  providing  accurata  raquasts 
for  laboratory  tasts. 


ANSBI* 

N-P,  March  1978 


7. 

AFCLAS  ha* 

been 

(1 

far  sore  effective  than 

1) 

slightly  store  effective 

than  1 
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about  a*  effective  a* 

( the  previous  system  in  retrieving  test 

(I 

slightly  less  effective 

than  / Inforstation  on  patients. 

(1 

■i9nlflc«ntly  X«ss  «ffectiv«  th«n  1 
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a. 

AFCLAS  respond* 

to  STAT  request*  in  a way  that 
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significantly  improves 
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1) 

slightly  improves 
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do«8  not  differ  from  the  previous  system  in  providing  \ petient  cere. 

[) 

slightly  impairs 
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(1 

significantly  Impairs 
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No  opinion 

/ 

9. 

AFCLAS  ha* 

(1 

significantly  iiqprovad 

\ 

(1 

slightly  improved 
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(] 

had  no  effect  on 

f the  ability  of  the  physician  to  use  clinical 

[) 

slightly  impaired 

? laboratory  data. 

(1 

significantly  impaired 

t 

(I 

No  opinion 

10. 

AFCLAS  has 

0 

significantly  ingtroved 

] 

u 

slightly  iag>roved 

i the  physician's  ability  to  locate  patient's 

11 

had  no  effect  on 

f clinical  laboratory  data  in  the  laboratory 

(1 

slightly  Impaired 

/ report. 

(] 

significantly  impaired 

11 

No  opinion 

11. 

AFCLAS  ha* 

(1 

significantly  increased 

) 

(1 

slightly  Increased 

/ 

(1 

had  no  effect  on 

f the  accuracy  of  clinical  laboratory  reports. 

(1 

slightly  decreased 

i 

[l 

significantly  decreased 

[l 

No  opinion 

! 

12. 

With  AFCLAS 

. the  clinical  laboratory 

(1 

functions  saich  more  smoothly. 

(1 

functions  slightly  mors 

smoothly. 

(1 

functions  about  the  same. 

(1 

functions  slightly  less 

siaoothly. 

(1 

function*  significantly 

less  smoothly. 

(1 

No  opinion 

13. 

With  AFCLAS 

. I 4 

im 

[] 

significantly  sere  knowledgeable  i 

(1 

slightly  sure  knowledgeable  I 

(1 

about  r*  knowledgeable  a*  in  the  past  > about  my  patients. 

tl 

slightly  las*  knowledgeable  1 

11 

significantly  less  knowledgeable  1 

(1 
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U.  With  JiTCLAS,  I am 

I)  much  more  confident  with 

{)  eliqhtly  more  confident  with 

I]  about  aa  confident  aa  I was  in  the  paat  with 

I)  sXiqhtly  leaa  confident  with 

(I  significantly  less  confident  with 

( I No  opinion 

IS.  With  AFCIAS,  the  format  of  information  in  leib  reports  is 


significantly  more 
slightly  more 
no  more 
slightly  less 
significantly  less 

No  opinion 


the  clinical  laboratory  Information 
that  I use  with  my  patients. 


convenient  to  use  than  was  the  previous  format. 


16.  AFCLAS  has 


significantly  decreased 
slightly  decreased 
had  no  effect  on 
slightly  increased 
significantly  increased 


the  time  that  I have  to  wait  for  routine  laboratory 
reports. 


Cl  No  opinion  ' 

17.  AFCLAS  provides  statistical  information  that  is 

(1  significantly  more  useful  in 

()  slightly  more  useful  in 

[]  no  more  useful  than  in  the  past  in 

I)  slightly  less  useful  in 

{)  significantly  less  useful  in 

()  No  opinion 

18.  AFCLAS  has  made  chart  reading 

(]  significantly  easier. 

I]  slightly  easier. 

[)  about  as  easy  as  before  AFCLAS. 

((  slightly  more  difficult. 

Cl  significantly  more  difficult. 


patient  care. 


No  opinion 


19 . AFCLAS  hat 


significantly  Improved 
slightly  improved 
had  no  effect  on 
slightly  isgtaired 
significantly  impaired 

No  opinion 


telephone  retrieval  of  test  information  by  calling  the 
laboratory. 


AFCLAS  has 


significantly  increased 
slightly  Increased 
had  no  effect  on 
slightly  decreased 
significantly  decreased 

No  opinion 


the  speed  in  retrieving  test  information  on  patients. 
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21. 

AFCLAS  ha:i 

(] 

siqnlficantly  decreased 

0 

sliqhtly  decreased 

1 

0 

had  no  effect  on 

N the  response  time  for  STAT  reports. 

(1 

sliqhtly  increased 

i 

11 

significantly  increased 

) 

(1 

No  opinion 

22. 

AFCLAS  haa 

1) 

significantly  decreased 

i 

(1 

slightly  decreased 

( 

11 

had  no  effect  on 

/ the  number  of  lost  test  reports. 

(1 

slightly  increased 

11 

significantly  increased 

) 

11 

No  opinion 

23. 

AFCLXS  has 

(1 

significantly  decreased 

J 

11 

slightly  decreased 

f 

(1 

had  no  effect  on 

} the  number  of  repeat  requests  for  laboratory  work. 

(1 

[1 

significantly  increased 

1 

(1 

No  opinion 

24. 

AFCLAS  hat 

(1 

significantly  increased 

\ 

(1 

slightly  increased 

j 

0 

had  no  effect  on 

1 the  legibility  of  laboratory  reports  filed  in  the 

11 

slightly  decreased 

t patient's  medical  record. 

(1 

significantly  decreased 

\ 

(1 

No  opinion 

25. 

AFCLAS  has 

1 

(1 

significantly  increased 

J 1 

11 

slightly  increased 

/ 

11 

had  no  effect  on 

} the  legibility  of  laboratory  reports. 

11 

slightly  decreased 

( 

(1 

significantly  decreased 

11 

No  opinion 

1 

26. 

AFCLAS  has 

(1 

significantly  decreased 

(1 

slightly  decreased 

i 

11 

had  no  affect  on 

the  number  of  times  that  I call  the  laboratory  to 

11 

slightly  increased 

( obtain  test  results. 

11 

significantly  increased 

\ 

[1 

No  opinion 

27. 

AFCLAS  has 

(1 

significantly  decreased 

\ 

(1 

j 

(1 

had  no  effect  on 

1 the  total  time  that  I spend  obtaining  and  using 

(1 

slightly  increased  1 

/ laboratory  reports . 

11 

significantly  increased 

\ 

(1 

No  opinion 
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28. 

ArCLAS  h«s 

1) 

significantly  improved 

J 

1) 

slightly  improved 

1 

0 

resulted  in  no  change  in 

^ relations  between  physicians  and 

laboratory  personnel. 

(1 

slightly  impaired 

1 

1) 

significantly  impaired 

) 

1 

1) 

No  opinion 

29. 

AFCLAS  has 

1 

(1 

significantly  decreased 

i 

i 

1) 

slightly  decreased 

/ 

(1 

had  no  effect  on 

i the  number  of  times  that  I visit 

the 

laboratory  to 

(I 

slightly  increased 

i obtain  test  results. 

tl 

significantly  increased 

11 

No  opinion 

1 

30. 

Cunulatlv*  laboratory  reports  provided  by  AFCLAS  are 

(1 

much  more  useful  than 

i 

11 

more  useful  than 

/ 

I) 

about  as  useful  as 

^ the  previous  laboratory  reports. 

11 

lass  useful  than 

( 

II 

saich  less  useful  than 

1 

II 

No  opinion 

11. 

AFCLAS  has 

II 

significantly  increased 

n 

slightly  increased 

1 

II 

had  no  effect  on 

\ the  percentage  of  laboratory  reports 

filed  in  the 

11 

slightly  decreased 

/ patient's  medical  record. 

II 

significantly  decreased 

1 

II 

No  opinion 

13. 

Ny  prisMiry  responsibility  is 

1 

1 

1 

fl 

inpatient  care. 

II 

outpatient  care. 

II 

other.  Please  specify 

13. 

Were  you  assigned  to  the  Wright-Patterson  Medical  Center  during  March  1976? 

II 

Y«s 

II 

No 

14. 

Mad  you  worked  < 

with  an  autoatated  laboratory 

information  system  before  coming  to 

the 

Wright- 

Fatterson  Medical  Center? 

II  Yes 

II  No 

Please  place  your  coeipleted  questionnaires 

into  the  accompanying  envelope,  seal 

the 

envelope,  and 

print  ttM  following 

information  on  the  front  of 

the  envelope: 

Name 

Department . 

ANSKP 

N>P,  March  1978 
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REGISTEKED  NURSI!<C.  STAFF  yOESTlONNAIRi: 


1 list  t uct  tons 

1.  Coffl|ilete  the  questlonnelre  on  the  basis  of  your  knowledqe  and  personal  ex('erience  with  the  clsnic.il 
laboratories  at  the  Wriqht-Patterson  Hedical  Center  and  other  clinical  laboratories  (Air  Force  and 
non-Mr  Force)  . 

r.  A Clinical  Laboratory  Automation  System  (AFCUiS)  was  installed  at  Wriqht-Patterson  Medical  Center 

2 years  aqn.  We  would  like  to  have  your  opinion — as  an  R.N, — of  the  impact  AFCLAS  has  had  on  your 
professional  activities, 

i.  Please  indicate  your  response  to  each  question  by  placinq  a mark  in  the  appropriate  box. 

4.  When  you  have  completed  the  questionnaire,  insert  it  in  the  accompanyinq  envelope,  seal  the 
envelope,  and  print  the  followinq  information  on  the  front  of  the  envelope: 

Name 

Department  or  Ward. 


This  information  will  be  used  only  to  ensure  that  responses  from  all  R.N. 's  at  Wriqht-Patterson 
Medical  Center  will  be  Included  in  the  study.  The  sealed  envelope  will  be  opened  only  by  the 
research  team  of  Analytic  Services  Inc.  (ANSER) , and  the  information  you  provide  will  be  available 
only  to  the  team. 


ANSCR 

W-P,  March  1978 


1.  There  has  been 


[)  a significantly  smaller  . 

11  a somewhat  smaller  / 

II  about  the  same  number  of  telephone  calls  for  STAT  results  with  Al'CLAS. 

1 1 a somewhat  greater  \ 

|]  a significantly  greater  ' 

1 1 No  opinion 


2. 


3. 


With  AFCLAS,  the  time  that  I spend  on  clerical  work  related  to  laboratory  re{)orts  has  been 


(1  significantly  reduced. 

IJ  slightly  reduced. 

1)  about  the  same  as  before  AFCLAS. 
(]  slightly  increased. 

I)  significantly  increased. 

1 1 No  opinion 


AFCLAS  has  made  it 


I)  much  easier 
()  somewhat  easier 
(I  as  easy  as  in  the  past 
11  somewhat  more  difficult 
[1  much  more  difficult 

[1  No  opinion 


to  obtain  information  on  status  of  leboratory  tests 
being  performed. 


4.  AFCLAS  has 


I)  significantly  decreased 
[1  slightly  decreased 
n had  no  effect  on 
I)  slightly  increased 
(1  significantly  increased 

11  No  opinion 


the  total  time  I spend  processing  test  requests  and 
laboratory  reports. 


S.  STATS  are  being  returned 


11 

much  faster  j 

(1 

somewhat  faster  f 

I) 

about  as  fast  as  in  the  past 

wi  Lh 

AFCLAS. 

11 

somewhat  slower  1 

tl 

much  slower  f 

11 

No  opinion 

6 . AFCLAS  has 

permitted  me  to  interact 

11 

much  more  effectively 

J 

II 

slightly  more  effectively 

f 

II 

about  as  effectively  as  in  the  past 

' with 

clinical  laboratory  personnel 

II 

slightly  less  effectively 

11 

much  less  effectively 

1 

1 1 No  opinion 


7 . AFCLAS  is 

[1  far  superior  to  J 

I ) superior  to  f 

1 1 about  the  same  as  > the  previous  system. 

tl  inferior  to  1 

( ] far  inferior  to  1 


ANSER 

W-P,  March  1978 


( ] No  opinion 


e. 

The  collection  of  specimens  has  been 

0 

much  better  nrqanized 

(1 

better  orqanited  i 

■ 

[1 

about  as  tfell  organized  as  in  the  past 

with  AFCLAS. 

0 

less  organized  i 

[) 

much  leas  organized 

1 

[] 

No  opinion 

J 

9. 

With  AFCLAS,  it  has  been 

0 

much  easier 

n 

easier  i 

n 

about  as  easy  as  in  the  past  ' 

to  tell  what  xabcratory  work  is  to  be  done 

[1 

more  difficult  i 

on  a given  day. 

(} 

much  more  difficult  1 

(1 

No  opinion 

10. 

AFCLAS  has 

made  it 

(1 

much  easier 

(1 

somewhat  easier  ^ J 

[] 

about  as  easy  as  in  the  past  ' 

to  obtain  information  about  patients' 

(1 

somewhat  more  difficult  j 

clinical  laboratory  results. 

0 

much  more  difficult  1 

(1 

NO  opinion  '' 

11. 

AFCLAS  has 

made  the  nurses'  tasks  in  ordering 

laboratory  tests 

[) 

asich  easier. 

(1 

sn.-sewhat  easier. 

(1 

about  as  easy  as  in  the  past. 

[1 

sosMwhat  sore  difficult. 

(1 

much  more  difficult. 

(] 

No  opinion 

12. 

Clinical  laboratory , reports  provided  by  AFCLAS  are 

[) 

much  easier 

] 

[] 

somewhat  easier 

f 

(1 

about  as  easy  as  in  the  past 

> to  read . 

[1 

somewhat  more  difficult 

1 

[] 

much  more  difficult 

1 

[] 

No  opinion 

13. 

With  AFCLAS,  it  is 

[J 

significantly  easier 

\ 

[] 

slightly  easier 

k 

(1 

about  as  easy  as  in  the  past 

[ to  schedule  patients  for  laboratory 

[] 

slightly  sore  difficult 

/ procedures. 

[1 

significantly  more  difficult 

0 

No  opinion 

14. 

AFCLAS  has 

Blade  posting  of  clinical  laboratory  reports  in  a patient's  chart 

(] 

anich  easier. 

(1 

sOBiewhat  easier. 

[] 

about  the  sasw  as  before  AFCLAS. 

{] 

SOBiewhat  Bore  difficult. 

[] 

Biuch  more  difficult. 

[] 

No  opinion 
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IS.  MVLAS  h«u 


[|  algnlftcAnllv  IncrnaaKd  i 

II  alight ly  lni:raaaoil  f 

1 1 had  no  affact  on  > duality  of  pat lant  cara. 

(I  a lightly  daoraaaod  I 

II  alqnlflcantly  dacraaaad  1 

II  No  opinion 

16.  With  M'CLAS,  tha  numhar  of  lalaphone  calla  that  I maka  to  thr  laboratory  la 

II  much  amallar. 

II  allghtly  amallar. 

II  about  tha  aama  aa  bafora  kFCI.A.S. 

II  allghtly  graatar. 

II  much  graatar. 

II  No  opinion 

17.  My  primary  reaponalbi I Ity  la 

II  Inpatiant  care. 

II  outpatlant  earn. 

II  othar.  rlaaaa  apaclfy  

18.  Wara  you  aaalgnad  to  tha  Wrlght-l’attaraon  Madlcal  Cantor  during  Hatch  19767 

1 1 Voa 

II  NO 

19.  Had  you  workad  with  an  automatad  laboratory  Information  ayatam  bafora  coming  to  tha 
Wright-Pattaraon  Madlcal  Cantor? 

II  Vaa 

II  NO 


Plaaaa  placa  your  complatad  quaatlonnaira  Into  tha  accompanying  anvaloj>a,  aaal  tha  onvolopa. 
and  print  tha  following  Information  on  tha  front  of  tha  anvalopai 

Nama 

liapartmant  or  Ward. 


ANSBH 

M-P,  March  197B 


LABOHATORY  STAFF  ^ESTIONNAIRtS 


Instructions 

1.  Complats  ths  first  attached  questionnaire  entitled  "Laboratory  Staff  Queationnaire  (1”  before  conpletinq 
the  Second  attached  questionnaire  entitled  "Laboratory  Staff  Questionnaire  ll." 

3.  Indicate  your  response  to  each  question  by  placlnq  a isark  In  the  appropriate  block. 

1.  Insert  the  completed  questionnaires  into  the  accompanying  envelope,  seal  the  envelope,  and  print  the 
following  information  on  the  front  of  the  envelope i 

Name 

Section. 

This  infonsation  will  be  used  only  to  ensure  that  responses  from  all  laboratory  staff  at  Nrlght-Patterson 
Hadlcal  Canter  will  be  Included  in  the  study.  The  sealed  envelope  will  be  opened  only  by  the  research 
team  of  Analytic  Services  Inc.  (ANSER) , and  the  Information  you  provide  will  be  available  only  to  the  team. 


AMUR 

W-P,  Hareh  197S 


LAHOKATC^RY  STAFF  CHJFSTlUNNAl RF  *1 


strongly  U„„rt.in  Dl..qr»  Strongly 

Agree  0&>«qree 


During  »y  dey  in  the  laboratory*  I do  leany  dlfferant  taaka« 


There  ie  an  opportunity  in  the  leborutory  for  Independent  thought 
and  action. 


In  contrast  with  workers  in  industry,  laboratory  |>oople  know  the 
final  results  of  their  %M3rk. 


Supervisors  in  the  laboratory  provide  valid  cosments  on  ay 
I'erformance. 


The  most  important  part  of  my  30b  is  helping  other  people. 


Laboratory  people  get  together  after  work  more  frequently  than 
do  people  in  other  parts  of  the  hospital. 


Hy  laboratory  assignment  permits  me  to  do  many  different  test 
procedures. 


Hy  supervisor  leaves  me  pretty  much  alone  to  perforin  my  work 
in  the  laboratory. 


1 know  how  well  1 am  performing  my  job  each  day. 


Dealing  with  other  people  in  the  laboratory  is  an  important 
part  of  my  job. 


Ihe  laboratory  is  a great  place  to  develop  close  friends. 


My  laboratory  assignment  permits  me  Co  use  many  different  kinds 
of  equipment. 


Supervisors  in  the  laboratory  provide  frequent  comments  on  my 
performance. 


Dealing  with  people  outside  the  laboratory  is  an  important  part 
of  my  job. 


1 perform  tasks  in  the  laboratory  Chat  arc  important  but  outside 
of  my  technical  specialty. 


During  a day  in  the  laboratory.  X use  many  different  pieces  of 
equipment. 


1 am  responsible  for  doing  complete  test  procedures  in  the 
laboratory. 


Mhile  on  duty,  there  is  almost  always  an  opportunity  to  talk 
with  laboratory  people  about  nonlaboratory  subjects. 


When  I Ml  on  duty,  the  order  in  which  1 perform  my  tasks, 
ewcept  STATS,  is  laft  up  to  ma. 


Automated  equipment  in  the  laboratory  does  not  interfere  with 
siy  decisions  about  the  tasks  X perform. 


When  1 complete  s laboratory  teat  procedure.  I consider  it  a 
result  of  »y  own  efforts. 


When  1 start  a teat  procedure,  I know  that  X will  have  the 
opportunity  to  aee  It  through  to  the  end  and  know  the  result. 


Supervisors  often  get  together  with  laboratory  people  after 
.duty  hours.  - — - — 


AN5ER 

March  1976 


LABORATORY  STAFF  OUESTIONNAIRF.  «2 


i.  The  normal  %M}rk  week  in  this  laboratory  is 

" leas  than  3S  hours. 

" 3S-40  hours, 

<>  40-45  hours. 

>*  45-50  hours. 

" over  50  hours. 

3.  Durinq  the  past  weak,  I worked  in  the  laboratory 

less  than  35  hours. 

" 35-40  hours. 

II  40-45  hours. 

'*  45-50  hours, 

” over  50  hours. 

3.  During  the  past  week,  I spent 

2 hours  or  less  ^ 

2-5  hours  # 

5-8  hours  ( on 

^ 0-11  hours  ? 

over  12  hours  i 


on  military  duties  outside  the  laboratory. 


n I have  no  military  duties  outside  the  laboratory. 
During  the  past  week,  I was  on  pass  or  leave 


5.  During  the  past  week,  I worked 


u less  than  1 
11  1-3 
u 3-6 
11  6-10 
over  10 


more  hours  than  the  normal  work  week  in  the  laboratory. 


6.  In  performing  my  tasks  in  the  laboratory,  I feel  that  I have 


□ much  more  than 
u more  than 
11  all  of 

<3  somewhat  less  than 
u much  less  than 


the  time  that  I need  to  accomplish  my  tasks. 


7.  In  performing  my  tasks  in  the  laboratory,  I feel  that  I have 


LI  much  more 

□ more 

□ about  the  same  amount  of 

□ less 

n much  less 


time  than  (that)  I would  expect  for  a laboratory  of 
this  type. 


8.  Mhen  performing  my  tasks  In  the  laboratory,  i am  rushed 

D rarely. 

□ occasionally. 

□ moderately  often. 

D often. 

o very  often. 


ANSER 

W-P,  March  1978 
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Mhrn  |'<>rfori*in<j  my  tank*  in  tlii'  laboratory,  I iim  rushed 


much  loss  olton  than 
loss  often  than 
about  as  often  as 
II  more  often  than 

I much  more  often  than 

• I No  opinion 

10.  The  quality  of  reports  in  this  laboratory  is 

" far  superior  to  \ 

II  sliqhtly  superior  to  i 

II  about  the  same  quality  as  I reports  for  similar  laboratories. 
" sliqhtly  inferior  to  ) 

" far  Inferior  to  i 

u No  opinion  ' 

11.  The  tisw  available  for  quality  control  in  this  laboratory  is 

II  more  than  is  needed. 

1)  all  that  is  needed. 

II  almost  all  that  is  needed. 

II  sliqhtly  less  than  is  needed. 

II  much  less  than  is  needed. 

II  Quality  control  is  not  part  of  my  job. 

12.  In  laboratories  such  as  this,  there  is  typically 

more  than  enouqh  time  ^ 

11  all  the  time  that  is  needed  I 

11  almost  as  much  time  as  is  needed  I for  quality  control. 

11  less  time  than  is  needed  / 

I-*  much  less  time  than  is  needed  I 

1^  No  opinion  ' 


13. 

Please  give 

your  rank  _ 

14. 

Please  give 

AFSC  number 

IS. 

Are  you  a student? 

11  Yes 

Cl  No 

16.  Nere  you  assigned  to  the  Department  of  Pathology  at  the  Wriqht-Patterson  Medical  Center  durinq 
March  19767 

(1  yes 
(1  No 


1 1 would  expect  in  a clinical  laboratory  of  thij  kind. 


Please  place  your  completed  questionnaires  into  the  accompanying  envelope,  seal  the  envelope,  and 
print  the  following  information  on  the  front  of  the  envelope: 

None 

Section. 


AMStR 

W-P.  March  1978 
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(TRILAB  I)  and  its  Impacts  as  perceived  by  the  hospital  staff. 

This  data  collection  period  at  Nright-Pattarson  AFB  is  referred 

to  as  Period  7..  end  rhe  reeul»_e  are  nomnared  wtrh  t-hoee  from  Ihe 
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20.  ABSTRACT  (continuad) 


Sana  aurvaya  admlnlatarad  during  Period  Y (6  months  after 
system  installation)  and  for  the  laboratory  staff  during 
Period  X (6  months  before  system  installation)  as  well. 


'"'-A The  principal  findings  of  these  surveys  may  be  summarized 
as  follows.  Physician  acceptance  of  TRILAB  I has  increased 
from  47  percent  in  Period  Y to  86  percent  in  Period  Z,  while 
nurses'  acceptance  of  TRILAB  I has  remained  at  about  70 
percent.  Nondollar  benefits  of  TRILAB  I perceived  by  phy- 
sicians include  improvements  in  patient  care/  ability  to 
follow  trends,  legibility  of  reports,  and  report  format. 

The  job  satisfaction  of  the  laboratory  staff  has  increased 
over  the  three  observation  periods.  Laboratory  staff  percep- 
tions of  %K>rklng  conditions  are  considerably  more  positive 
than  those  in  Period  Y,  and  slightly  more  positive  than 
those  in  Period  X. 
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